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Boutet de Monvel operators on Lie manifolds with boundary 1 


Karsten Bohlen 


Abstract 

We introduce and study a general pseudodifferential calculus for boundary value problems on a 
class of non-conrpact manifolds with boundary (so-called Lie manifolds with boundary). This 
is accomplished by constructing a suitable generalization of the Boutet de Monvel calculus for 
boundary value problems. The data consists of a compact manifold with corners M that is 
endowed with a Lie structure of vector fields 2V, a so-called Lie manifold. The manifold M is 
split into two equal parts X + and A_ which intersect in an embedded hypersurface Y C X±. 
Our goal is to describe a transmission Boutet de Monvel calculus for boundary value problems 
compatible with the structure of Lie manifolds. Starting with the example of b -vector fields, we 
show that there are two groupoids integrating the Lie structures on M and on Y, respectively. 
These two groupoids form a bibundle (or a groupoid correspondence) and, under some mild 
assumptions, these groupoids are Morita equivalent. With the help of the bibundle structure 
and canonically defined manifolds with corners, which are blow-ups in particular cases, we define 
a class of Boutet de Monvel type operators. We then define the representation homomorphism 
for these operators and show closedness under composition with the help of a representation 
theorem. Finally, we consider appropriate Fredholm conditions and construct the parametrices 
for elliptic operators in the calculus. 
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1. Introduction 


In this work we will enlarge the groupoid pseudodifferential calculus introduced in [30] and 


develop a general notion of a pseudodifferential calculus for boundary value problems in the 
framework of Lie groupoids. The most natural approach seems to be along the lines of the 
Boutet de Monvel calculus. Boutet de Monvel’s calculus (e.g. [3]) was established in 1971. This 
calculus provides a convenient and general framework to study the classical boundary value 
problems. At the same time parametrices are contained in the calculus and it is closed under 
composition of elements. 


1.1. Overview 

In our case, consider the following data: a Lie manifold ( X , V) with boundary Y , which is an 
embedded, transversal hypersurface Pclin the compact manifold with corners X and which 
is a Lie submanifold of X (cf. 0, 0)- The Lie structure V C T(TA) is a Lie algebra of 
smooth vector fields such that V is a subset of the Lie algebra Vb of all vector fields tangent to 
the boundary strata and a finitely generated projective C'°°(A)-module. From X we define the 
double M = 2X at the hypersurface Y which is a Lie manifold (M, 2 V). The corresponding 
Lie structure 2V on M is such that V = {V\x '■ V £ 2V}. Transversality of Y in relation to M 
means that for each given hyperface F C M we have 

T X M = T X F + T X Y , x eY (IF. (1) 

Introduce the following notation for interior and boundary: by dM we mean the union of all 
hyperfaces of the manifold with corners M, 


M 0 := M \ dM, Y 0 := Y n M 0 , X 0 := X n M 0 and dY := Y <1 dM. 

For an open hyperface F in M we denote by F the closure in M. Denote by d reg F = d reg F = 
F nY the regular boundary of F. The hypersurface Y is endowed with a Lie structure as in ( 2 ]: 

W = {Vj y '■ V £ 2V, Vj y tangent to Y}. (2) 

We make the following assumptions: i) The hypersurface Y is embedded in M in such a way 
that the boundary faces of Y are in bijective correspondence with the boundary faces of M. 
This means the map F(M) 3 F i->- F fl Y € X{Y) should be a bijection, where F(M),F(Y) 
denotes the boundary faces of M and Y respectively, ii) Secondly, we assume that for the given 
Lie structure 2V there is an integrating Lie groupoid Q which is Hausdorff, amenable and has 
the local triviality property: Qf — F x F x G for any open face F of M (where G is an isotropy 
Lie group). Also Qm 0 — Mq x Mo is the pair groupoid on the interior and A\m 0 — TMq the 
tangent bundle on the interior. 

Note that the first assumption poses no loss of generality in the consideration of boundary 
value problems: We can always consider a small tubular neighborhood of Y and restrict the 
groupoid accordingly. Away from such a neighborhood there are no boundary value problems to 
be considered. The second condition is needed in the parametrix construction at the end of this 
work. In the main body of the paper we give examples of Lie structures for which it is known 
that they have integrating Lie groupoids that are Hausdorff, amenable and locally trivial. From 
now on we fix a Lie manifold with boundary with the notation given above and fulfilling the 
previous assumptions. 

The goal is to construct a Boutet de Monvel calculus for general pseudodifferential boundary 
value problems adapted to this data. We model our construction on the pseudodifferential calcu¬ 
lus on a Lie manifold as described in [ 3 J. The authors define a representation of pseudodifferential 
operators on a Lie groupoid, i.e. a ^-homomorphism from equivariant operators acting on the 
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groupoid fibers to operators acting on the original manifold with corners. Since the pseudodiffer¬ 
ential calculus on a Lie groupoid is closed under composition (cf. [30]), a representation theorem 
automatically yields closedness under composition for the corresponding pseudodifferential cal¬ 
culus on the given Lie manifold. In order to construct a groupoid calculus for boundary value 
problems we first consider the Lie algebroid A 2 y —> M such that T{A 2 v) — 2 V using the Serre 
Swan theorem. We fix a Lie groupoid Q =1 M fulfilling our assumptions such that A(G) — A- 2 V- 
On the boundary Lie structure on Y we also obtain a groupoid Gg = Gy =4 Y with an associated 
Lie algebroid ng: Ag —> Y. We define a boundary structure in the following way: We introduce 
X = G ' 1 = ?’ _1 (y), which is a longitudinally smooth space and can be viewed as a desingular- 
ization of Y x M with regard to the diagonal Ay, suitably embedded as manifolds with corners, 
as well as X t = Gy = s _1 (T) of M xY with regard to Ay. There is a canonical diffeomorphism 
f: X —> X 1 . Additionally, the spaces X and X 1 implement a bibundle correspondence between 


G and Gg as defined by Hilsum and Skandalis, [la]. Since the hypersurface Y divides the double 
M = 2X we denote by X := X + the right half and by X _ the left half. These halves have 
corresponding Lie structures and hence corresponding groupoids G± ^4 X±. On the symbols 
of pseudodifferential operators from the groupoid calculus we impose a hberwise transmission 
property with regard to the subgroupoids G + ,G~ C G • The compatibility requirements we will 
state particularly imply that G + ,G~ have hberwise boundaries consisting of the fibers X x for 
x € X±. The Boutet de Monvel operators are defined and adapted to data given by the bound¬ 
ary structure, i.e. the tuple (G, Gg, £7 , X, X*,f)- The boundary structure depends on the initial 
Lie structure and integrability properties of the corresponding Lie algebroids. 


1.2. Results 

The Boutet de Monvel calculus adapted to this data is denoted by B°'°(G + , Gg) (of order 0 and 
type 0) and consists of matrices of operators, which are equivariant families of operators, such 
that 

(C?{G + )\ 

B°’°(G + ,Gg)C End © . 

\C?(Gg)J 

The first objective of this work is the proof of the following result. 

Theorem 1.1. Given a Lie manifold (X,V) with embedded hypersurface Y C X yielding a Lie 
manifold X with boundary Y such that M = 2X , the double. Then for a pair of associated 
groupoids G ^4 M, Gg 4 L adapted to a boundary structure the equivariant transmission Boutet 
de Monvel calculus is closed under composition. This means that given the order m G Z we have 

B m ’°{G + ,Gg)-B 0 '°(G + ,Gg) c B m ’°(G + ,Gg). 


In the next step we describe a vector-representation of our algebra. Just as in the case of a 
pseudodifferential operator on a groupoid there is a homomorphism which maps B°'°(G + , Gg) to 
an algebra By°(X, Y). The first algebra on the left consists of equivariant families on a suitable 
boundary structure. This algebra on the right hand side is defined to consist of matrices of 
pseudodifferential, trace, potential and singular Green operators. These operators are extensions 
from the usual operator calculus on the interior manifold with boundary (Xo,lo)- Hence we 
want to define a homomorphism qbm of algebras from 

fC™(G + )\ fC°°(X)\ 

End 0 ) D B 0fi {G + ,Gg) ^B°/(X,Y) C End © . 

\C?{G d )j \C°°(Y)) 
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The vector representation is characterized by the defining property 

(eBM(A) o Q = /l , / € C“(X), g € C°°(Y), A € S» 0 (S+,S e ) 

where r: C/ + —>• M, rg: Qq —> Y denote the corresponding range maps (local diffeomorphisms). 
It is a non-trivial task to prove that in certain particular cases qbm furnishes an isomorphism 
between these two algebras. Furthermore, as can already be shown by simply viewing the special 
case of pseudodifferential operators, it is not true in general. Instead we prove an analog of a 
result due to Annnann, Lauter and Nistor (cf. [3]). 

Theorem 1.2. Given the vector representation qbm and a boundary structure we have the 
following isomorphism 

QBM{B m ' 0 (g + ,g d ))=B™’°(x,Y). 


A priori, the inverse of an invertible Boutet de Monvel operator will not be contained in our 
calculus due to the definition via compactly supported distributional kernels. We define a 
completion B v °°' ( X , Y) of the residual Boutet de Monvel operators with regard to the family 

/H* V (X) Hy(X) \ 

of norms of operators £ © , © on Sobolev spaces, cf. |4[. Define the completed 

W w (Y) H w(Y)) 

algebra of Boutet de Monvel operators as 

B$°(X, Y) = B°fi°(X, Y) + Bv°°’°(X, Y). 

The resulting algebra contains inverses and has favorable algebraic properties, e.g. it is spectrally 
invariant, cf. section 0 We obtain a parametrix construction after defining a notion of Shapiro- 
Lopatinski ellipticity. The indicial symbol TZp of an operator A on X is an operator TZf(A) 
defined as the restriction to a singular hyperface F C X (see |3|). Note that if F intersects the 
boundary Y non-trivially we obtain in this way a non-trivial Boutet de Monvel operator TZf(A) 
defined on the Lie manifold F with boundary F (lY. 

We say that an operator A £ Bf (X. Y) is V-elliptic if the principal symbol and the principal 
boundary symbol of A are both pointwise invertible. If a V-elliptic operator A has pointwise 
invertible indicial symbols 1Zf(A) for each singular hyperface F we call A elliptic. Then we 
prove the following result. 

Theorem 1.3. i) Let A £ By°(X, Y) be V-elliptic. There is a parametrix B £ 7^°(X,Y) of A, 
in the sense 

I — AB £ Fv°°’ 0 (X, Y), I - BA £ Bv°° ,0 (X, Y). 

ii) Let A £ By°(X, Y) be elliptic. There is a parametrix B £ By°(X,Y) of A up to compact 
operators 

(L 2 V (X)\ (L 2 V {X)\ 

I- AB £ /C © \,I-BA £}C © . 

VUY)J \L 2 W {Y)J 


An application of groupoids to boundary value problems can be found in [§]. We also refer to 
recent work of Debord and Skandalis where the Boutet de Monvel algebra is being studied using 


deformation groupoids 111 ]. It would be interesting to explore applications of the calculus to 


cases of manifolds with piecewise smooth boundaries previously considered in the literature. One 
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example are Lipschitz boundaries, cf. [19], [26j], [25[. On the other hand potential applications 


to the 9-problem could be explored, see [U 
The paper is organized as follows. In Section 2 we recall the definition of Boutet de Monvel’s 
calculus in the standard case and study an example for our construction. In Section 3 we briefly 
summarize the definitions and notation for Lie groupoids, groupoid actions and Lie algebroids. 
There we also introduce operators defined via their Schwartz kernels and discuss reduced kernels. 
Section 4 is concerned with the notion of boundary structure. We motivate the definition by 
considering known examples of Lie structures with corresponding integrating Lie groupoids. We 
prove that under our assumptions such a boundary structure or tuple exists. In Section 5 we 
introduce the extended operators of Boutet de Monvel type which are special instances of the 
operators defined in Section 3. Then we show how to compose these operators in Section 6. 
Section 7 is concerned with the definition of the Boutet de Monvel calculus with regard to a 
given boundary structure. We prove the closedness under composition and the representation 
theorem. In Section 8 we describe several properties of the calculus, including order reductions 
and continuity on Sobolev spaces. Section 9 is concerned with the construction of parametrices 
in the Lie calculus. 
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2. Boutet de Monvel’s calculus 

2.1. Properties 

The calculus of Boutet de Monvel contains the classical boundary value problems as well as 
their inverse if it exists and parametrices. This calculus was developed in 1971, see [7]. Let for 
the moment X be a smooth compact manifold with boundary denoted dX = Y. Let P be a 
pseudodifferential operator on a smooth neighborhood M of the manifold with boundary. We 
denote by P + = X + Px° the operator obtained from P via extension by zero x° of functions 
defined on X to functions on M and restriction x + t° V. The pseudodifferential operator 
P should fulfill the transmission property, i.e. P + should map functions smooth up to the 
boundary to functions again smooth up to the boundary ( 0 , p. 23, (1.2.6)). Furthermore, 
G: C°°(X ) — > C°°(X) is a singular Green operator ([13], p. 30), K: C°°(dX) — > C°°(X) is a 
potential operator ([14], p. 29) and T: C°°(X) —y C°°(<dX) is a trace operator ([13], p. 27). 
Additionally, S' is a pseudodifferential operator on the boundary. Elements of the calculus consist 
of matrices of operators 

C'°°(V,Pi) C°°{X,E 2 ) 

© -)■ © eB m ’ d (X,dX) (3) 

C°°(dX, Fi) C 00 {dX 1 F 2 ) 

The calculus has the following notable properties. 

• If the bundles match, i.e. E\ = E 2 = E, F\ = F 2 = F the calculus is closed under 
composition. 


A = 


P+ + G 
T 


K 

S 
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• If F\ = 0, G = 0 and K , S are not present, the classical BVP’s are contained in the 
calculus, e.g. Dirichlet problem. 


If F ‘2 = 0 and T, S are not present, it contains inverses of classical BVP’s if they exist. 


It is non-trivial to establish the closedness under composition, which means that two Boutet de 
Monvel operators composed are again of this type, compare the standard references 14], [33]. 


2.2. An elliptic boundary value problem 

In this section we will study a Shapiro Lopatinski elliptic boundary value problem adapted to 
a Lie manifold with boundary. Specifically, we consider the appropriate generalization of the 
problem discussed in Section 2 of (2Q ], We therefore fix the data in the introduction, a Lie 
manifold (X, V) with boundary (Y, W) and double (M, 2V). 

Let smooth hermitian vector bundles E,F — >• M, restrictions E, F — >• X as well as Fj —> M 
for j = 1, • ■ ■ , L be given. We fix the differential operators on the double Lie manifold Bj e 
Diff ™j(M-,E,F) for j = l,-- - ,L and P e DifBJy(M, E, F). Set T = (j Y o (B - ,7 Y 0 
(Bl ).|_) < for the trace operator and let d := rnaxjv, rrij + 1 . 

We consider the following boundary value problem 

P + u = f in V, 

Tu = g on Y. 


The problem A 
Sobolev spaces 


P. 


in particular yields a continuous linear operator on the appropriate 


A = 


P+ 

T 


TTS — m 

H v 


: HUX,E) 


s-rrii-^ 


(X,F) 

(' Y,Fj\Y ) 


Theorem 2.1. Assume the boundary value problem A = ^ ^ J is Shapiro-Lopatinski elliptic 
(in the sense of Definition \9.Ji\ in section ^) , then for s > max{m, d} — ^ 


H(A m (X,F) 

h y {x, E) —» _ © 

®f=iH S w mj ~ 2 (Y,F jlY ) 

is Fredholm. 

There is a parametrix V = {Q+ + G K\ • • • Kjf) of A in the completed Lie calculus 

m,max{0,d tti\ / -\r\ / c # • rrrii 

B v 1 J (X,y) (^c/. section \$). 

Here G is a singular Green operator of order —m and Kj are potential operators of order —mj—\. 



Proof. We fix the pseudodifferential order reductions (cf. section [8l []4f]> 0]) 

R f . HbfrFjy) H s w ^(Y,F jIY ) 

in the completed pseudo differential calculus (Y), fij = m — mj — j = 1, ■ ■ ■ , L. 
Set 

R,\ 0 0 

0 0 r l 
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and consider for s > ma x{m, d} — ^ the operator 


B = 


1 0 
0 R 


P+ 

T 


HUX,E) 


TTS — m 

H v 


TTS — m 


(X,F) 

F,J+) 


where J + = ®j =1 F^ Y - 

We obtain an elliptic pseudodifferential boundary value problem contained in the completed cal¬ 
culus B € ~By ( X , Y). The ellipticity follows by the multiplicativity of the principal and princi¬ 
pal boundary symbol in Lemma [9.21 By Theorem ll.3l there is a parametrix V € B Y ' n ^ d m ^ + (. X, Y ) 

up to residual terms. Hence V = V ^ yields a parametrix of A. The Fredholm property 
of V follows by another application of Theorem 11.31 part (b). □ 


3. Groupoids, actions and algebroids 

3.1. Lie groupoids 

Definition 3.1. Groupoids are small categories in which every morphism is invertible. 

First we will introduce and fix the notation for the rest of this paper. Then we will give the 
definition of a Lie groupoid. For more details on groupoids we refer the reader for example to 
the book [31]. 


Notation 3.2. A groupoid will be denoted Q ^ . We denote by the set of morphisms 

and by the set of objects. By a common abuse of notation we write Q for We have 

the range / source maps r, s: Q —> such that 7 € Q is 

7 : s( 7 ) -s- r( 7 ). 

The set of composable arrows is given as pullback 

g(2) := g( i) x ^ (o) g( 1) = G Q X Q : r{rj) = s(7)}. 

Also denote the inversion 


and unit map 

Multiplication is denoted by 
We also set 


i: Q —> <3, 74 7' 1 
u: —> Q, x i->- u(x) = id x € Q. 

m : g { 2 ) ^g, ( 7 , 7 ) h - s > 7 • r]. 


Q x := Q x := r~ L {x), Q x x := Q x n Q x 

for the r and s fibers and their intersection Q x . The latter is easily checked to be a group for 
each x € Q 1 ' 0 ' 1 . 

Axioms: One can summarize the maps in a sequence 

■* gg g^y^g. 


g&- 

With the above notation we can give an alternative way of defining groupoids axiomatically as 
follows. 

(i) (so u) | e (o) = (r o u)\ gi0 ) = idg(o). 
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(ii) For each 7 £ Q 

(u o r)(7) -7 = 7, 7 • (u o s)( 7) = 7. 

(in) s o i = r, r o i = s. 

(iv) For (7,7) € Q^ we have 

r( 7 ■ 7) = r(7), s(7 • 7) = s(r/). 

(v) For (71,72), (72,73) S (/ (2) we have 

(71'72) • 73 = 7i ' (72 • 73)- 


(vi) For each 7 £ 5 we have 


7 1 ■ 7 = id s ( 7 ), 7-7 1 =idr( 7 ). 

Definition 3.3. The 7-tuple (G 1 ' 0 ' 1 , G^, r, s, m, u, i) defines a Lie groupoid if and only if Q ^ G^ 
is a groupoid, M := G^°\ G^ are C^-manifolds (with corners), all the maps are C°° and s is 
a submersion. 

Remark 3.4. We notice that r is automatically a submersion due to the axiom in). Hence the 
pullback 

(/( 2 ) -2-> a 

P2 S 

g— r —?M 

exists in the C^-category if Q is C°° and thus Q^ is a smooth manifold as well. 

3.2. Groupoid actions 

Given a Lie groupoid Q M we introduce spaces X which are fibred over G^ and such that Q 
acts on X. This notion as well as some of the notation is adapted from the paper [32]. 

Definition 3.5. Let (X,q) be a (/-space, i.e. q: X —> M is a smooth map and X is a smooth 
manifold. Set X *Q := X XmG = {( 2 , 7 ) € X x Q : q(z) = r(y)} to be the composable elements. 
We say that Q acts on X from the right if the following conditions hold: 

i) For each (2,7) £ X * G 

q(z-'y) = s( 7). 

ii) For each (2,7) £ X * Q and (7,7) € G^ 2 ' 1 

z ■ (7 ' V) = (z ■ 7 ) ' V- 


Hi) For each ( 2 , 7 ) € X *G we have 

(z- 7 ) ' 7 _1 = z. 

A left action of G on a (/-space (X,p) is a right-action in the opposite category G op . 

Remark 3.6. Note that for any 77-space ( X,p ) which is additionally fibered meaning p is a 
surjective submersion then the pullback 77 * A exists in the C^-category if 77, X are C°°. 
Analogously for a fibered (/-space. 
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Consider the following actions of two Lie groupoids G,R- 


H 

ft(°) 



G 

g(o) 


We can define a so-called left Haar system on X induced by the action of R and analogously a 
right Haar system induced by the action of Q. This enables us to define left- and right-operators 
coming from the actions. 

Let {A. T } xe g(o) be a Haar system induced on X by the right action of G, see also |32], p. 6 . This 
is a family of measures such that 

• The support is supp X x = X x for each x £ £T°b 

• The map 

G (0) / fd\ x 

Jx x 

is C°°. 


• We have the invariance condition 



f (z ■ 7 ) dA r ( 7 )(z) 



f(w) d\ s(7) (w). 


(4) 


Fix the right-multiplication for given 7 £ G 

r 7 : X r (7 ) - 4 > X s ( y ), z H- z- 7 . 

This is a diffeomorphism. 

The induced operators acting on C^-functions are given by 

i? 7 : C™(X s[y) ) -4 C™(X r{7) ), (Ryf)(z) := f(z - 7 ), z € X. 

These operators 1Z 7 yield *-(anti-)homomorphisms since (i ? 7 ) _1 = R y -1 is the inverse and 
R 1 . v = R v o R 7 , ( 7 ,rj)£G (2) - 

Definition 3.7. i) A continuous linear operator T: C^°(G) —> C£°(X) is called a right X- 
operator if and only if T = (T x ) xe g( 0 ) is a family of continuous linear operators T x : C£°(G x ) —>• 
C£°(X x ) such that 

R 7 -iT r ( 7 )R 7 = T s ( 7 ), 7 € Q. (5) 

This can be expressed alternatively by requiring the following diagram to commute for each 

7 G G 

c?(G s{j) )-^c™(x s{7) ) 

V R i 

c?(g r{7) )^c™(x ril) ). 
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ii) By analogy T : C%°(X) —¥ C^°(TL) is a left X-operator if and only if T = (T y ) ye ^ 0 ) is a 
family of continuous linear operators T y : C£°(X y ) —> C£°('H y ) such that the diagram 

C?{X^))^C?{U S{1) ) 

L-y 

C?{X^))^C?{H r ^) 


commutes for each 7 G T~L where T 7 denotes in this case the corresponding left multiplication. 

The next Proposition tells us that the family of Schwartz kernels (k x ) xe g(o) for a given T-operator 
can be replaced by a so-called reduced kernel. This is not unlike the situation for groupoids and 
the pseudodifferential calculus where reduced kernels are used extensively (cf. [301]). 

Proposition 3.8. Given a right-X-operator T: C£°(Q) C%°(X). Then for u G C£°(G), z G X 

(Tu)(z) = [ k T {z -7 - 1 M7) diiqi^O) 

with kx(z • 7 -1 ) := k r ^(z, 7 ) depending only on z ■ 7 -1 G X for each (z, 7 -1 ) G X * Q. 

Proof. First we can write for z G X 

(# 7 -iT r( 7 )j R 7 )u(>) = (T r ^Ryu)(z • 7 -1 ) = / k r(ry )(z • 7 _ 1 , 77 )^( 777 ) rf/x r ( 7 ) ( 17 ) 

y G r (-f) 

= f k r{l) {z-r\v-T-Mv)dpL s{l) {r,) 


via the substitution fj : = 
integral equals 


777 and invariance of Haar system. By use of ([5]) we see that the last 

(T s ( l)U )(z)= / & s ( 7 ) {z, rj)u{rj) d/r s ( 7 ) ( 77 ). 

d G s {-f) 


This implies the following identity by the uniqueness of the Schwartz kernel for T x for each 
x G M 


k s ^( z , fj ) = k r ^(z • 7 77 • 7 x ). (*) 

To see that kr is well-defined assume f3 = z ■ 7 _1 = z ■ 7 _1 and 5 = 7 -1 • 7, then 

k s ( 7 )( 5 , 7 ) = k 3 (g)(z, 7 ) = 0 k^izS- 1 , 7 < 5 _1 ) 

= k s ^)(z, 7 ). 


This completes the proof. 


□ 


5.5. Tie algebroids 


The aim of this section is to give a definition 
ourselves to the bare minimum needed in the 
exposition the reader may consult e.g. 


M- 


of Lie algebroids and subalgebroids. We restrict 
following text of the paper. For a more detailed 
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Definition 3.9. • A Lie algebroid is a tuple (E, g). Here n: E — > M is a vector bundle 

over a manifold M and g: E TM is a vector bundle map such that 

Q ° W, W]r(.E) = [q ° V, g o W]y(tm) 


and 

[V, fW] r{E) = f[V, W] V{E) + g(V)(f)W ., f € V,W € T(E). 


Given two Lie algebroids (A, g) and (A, g) over the same manifold M. Then a Lie 
algebroid morphism is a map ip: A —» A making the following diagram commute 


TM 



and such that ip preserves Lie bracket: <^[H, W]y(A) = [f?(V), 0(W)\t{tm)- 
We briefly summarize some relevant facts about the construction of Lie algebroids. 

• For any given Lie groupoid Q we obtain an associated algebroid A(G) in a covariantly 
functorial way. Define T S Q := ker (ds) the s-vertical tangent bundle as a sub-bundle of TQ. 
Denote by T(T S G) the smooth sections and define Tr(T s G) as the sections V such that 

V(rn) = for ( 77 , 7 ) € G {2) ■ 

We then define the Lie-algebroid associated to G via the pullback 

A(G)-^T s G 

K\s 

M --— >G. 

In other words A{G) := {(V, x)\ds(V) = 0 , u(x) = l x = 7 r( V)}. 

• There is a canonical isomorphism of Lie-algebras T r{T s G ) — T(A(G)). The set of smooth 
sections T(A(G)) is a C'°°(M)-module with the module operation / • V = (/ o r) • V with 
/ € 

• Let A(G) be given as above and define g: A(G) —> TM by g := drou*. Then (A(G), g) so 
defined furnishes a Lie algebroid. 

• A Lie algebroid is said to be integrable if we can find an associated (with connected s-fibers) 
Lie groupoid. Not every Lie algebroid is integrable Q. 
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4. Boundary structure 


With the given Lie manifold with boundary we want to associate a so-called boundary structure. 
We define a boundary structure and we show that for particular examples of Lie structures 
there is a boundary structure. What is necessary in the general case is a certain assumption on 
the groupoids Q. Qg. namely they ought to define a bibundle structure which we are going to 
specify. The boundary structure is in fact a good analogy for blow-ups of the corners which are 
the intersections of Y with the (singular) boundary at infinity of M. These blow-ups are in our 
setup canonically defined in terms of Q and Gg, the groupoids integrating A and Ag. 

Recall that a bibundle correspondence between two Lie groupoids Q and T~L implemented by X 
is a left R-space (X,p) and a right (/-space ( X,q ) with free and proper right action of G on X 
such that there is a homeomorphism X/Q —> 7i ^ induced by p and the actions of Q and T~L 
commute, see also 0 - 

In the following we give the axioms necessary to define a boundary structure. 

Definition 4.1. A boundary structure is defined as a tuple (G, Gg, £7 , X, X*, f) consisting of a 
Lie groupoid GAM and two manifolds (possibly with corners) X, X t which are diffeomorphic 
via a flip diffeomorphism f and subgroupoids G ± A X± of Q. 

We impose the following axioms on this data: 

i) A(G) — A 2 V, A(Gd) — Ag as well as ^.(^ =t ) = Ap as Lie algebroids. 

ii) X is a right Q- and a left f/Q-space and X 1 is a left Q- and a right (/g-space and these actions 
implement a bibundle correspondence between Q and Qg. The charge maps of the actions 
p: X —>• Y, q: X —> M and p t : X 1 —> M, g*: X f —> Y are such that p and q f are surjective 
submersions. 

Hi) Restricted to the interior we have 

X\Y 0 xM 0 = P~ l {Mf) n q-\Y 0 ) = Y 0 x M 0 , 

X\M 0 xY 0 = (pTHMo) n (g*)" 1 ^) = Mo x F 0 . 

iv) The fibers of are the interiors of smooth manifolds with boundary, namely: 

&regG x — 'R-, X G A 4 - 

dreg G x — X x , X C -V . 


Example 4.2. i) Consider a compact manifold X with boundary dX = Y and interior X := 
X \ Y. Then we also fix the double M = 2X. In this (trivial) case the spaces are given by 
X := Y x M, X t = M x Y with the flip f (x',y) = (y,x'), (. x',y ) G Y x M. We have here the 
pair groupoids G = M x M, Gg = Y x Y as well as G + = X + x G~ = X_ x X-. Then p. q 
are just the projections tt\ : Y x M —> Y, tt 2 : Y x M —> Ad. 

ii) We consider the Lie structure Vb := {V G r°°(TM) : V tangent to T), 1 < i < N}, cf. 23]. 
The Lie algebroid A —> M is the 6-tangent bundle such that T(A) = Vi,. Following Monthubert 
[ 2 ^], we find a Lie groupoid Gb(M) integrating A which is s-connected, Hausdorff and amenable: 
We start with the set 


Tfe(M) = {(x,y, A) G M x M x (R + ) N : pi(x) = A iPi(y), 1 < i < N} 

endowed with the structure {x,y. A) o ( y,z,p ) = (x,z, A • p), (x,y, A)^ 1 = (y,x, A -1 ) and 
r(x,y, A) = x, s(x,y,A) = y, u(x) = (x,x. l). Here multiplication A • p and inversion A^ 1 
are componentwise. 

We then define the 6-groupoid Gb(M) as the s-connected component (the union of the connected 
components of the s-fibers of Tft(M)), i.e. Gb(M) := C s Tb{M). 
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in) Fix the Lie structure V C; of generalized cusp vector fields for l > 2 given by the local 
generators in a tubular neighborhood of a boundary hyperface: {x[d xi , d X2 , ■ ■ ■ ,d Xn }. Let us 
recall the construction of the associated Lie groupoid the so-called generalized cusp 

groupoid, given in [21] for the benefit of the reader. We set 

L/(M) := {(x,y,y) G M X M x (R+) N : MPi{x) 1 pi(y) 1 = pi(x) 1 - Pi(y) 1 } 

with structure r(x , y , A) = x , s(x, y , A) = y, u(x) = (x, x , 0) and (x, y, A)(y, z, y) = (x, z, A + /r). 
We then define Qi(M) as the s-connected component of Ti(M). 

iv) The following example of the fibered cusp calculus is from Mazzeo and Melrose [24.] and we 
use the formulation and notation for manifolds with fibered corners as given in jTc|. We briefly 
recall the definition of the associated groupoid and refer to loc. cit. for the details. See also |13j 
for the precise geometric construction of the Lie groupoid for a different type of fibered cusp Lie 
structure. Write it = (-/ri, • • • , ttn), where 7Tj: Fj —>■ Bi are fibrations; Bi is the base, which is a 
compact manifold with corners. Define the Lie structure 

V 7 r := {V G Vfe : V\p. tangent to the fibers 7r*: F* —)• Fj, Vpi G pfC°°{M)}. 

Then V n is a finitely generated C'°°(M)-module and a Lie sub-algebra of r°°(TM). The corre¬ 
sponding groupoid is amenable 0, Lemma 4.6]; as a set it is defined as 

G W (M) := (M 0 x M 0 ) U (jJ(F, ; T " B i F i) x » 

where T n Bi denotes the algebroid of Fj. 

Theorem 4.3. For the Lie structure V G {V&, V C; , V n }, l > 2 there is a boundary structure. 

Proof. The claim is proven for the case V = V&. For the other cases the argument goes along the 
same lines, so we omit it. We have the fixed boundary defining functions for the hyperfaces of M 
and denote this family by On Y there are the boundary defining functions (relative to T), 

denoted by (qj)j£j. These are the boundary defining functions of the faces from the intersections 
of Y with the strata of M. We set X := r ~ : (T) = and X 1 := s _1 (T) = Q(M)y . 

Consider now the topology of X and X t . It is defined in local charts by the rule 


Y 0 x Mq 3 (x' n ,y n ) ->• (x',y, A = (Xj)jel) 


Qjjx'n) 

PiiVn ) 


A j, n -4 oo, i,j G I, x' n 


x , y n 


y- 


The right action of Q{M ) on X is given by right composition and the left action of G(Y) is given 
by left composition. On the interior we only have the pair groupoids. This yields the trivial 
actions 

Yq x Yo (5 To x Mo O Mq x Mq 

p=7Tl 


q=TT 2 


Yq 


Mq 


These actions can be extended continuously to the closure of To x Mo in Q and also of Mo x Yo, 
and we obtain from the definition of the topology that 


X = Yq X Mq , X = Mq X Yq~ 
The continued actions are defined 

G(Y) oxo g(M) 


M 
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Axiom i) holds because of [28j where it was shown that the given 6 -groupoids integrate the Lie 
structure of ^-vector fields. It is immediate to check that the actions commute and by definition 
the charge map q induced by the source map of Q(M) is a surjective submersion. The action of 
Q(M) on its space of units is free and proper, hence the action of Q(M ) by right composition on 
X is free and proper. Here properness means that the map X —» X x X, (z, 7 ) e-?• (zy, z) 

is a homeomorphism onto its image. Let zy = z then q(z ) = r(z) = r(y) which implies 
composability and s(y) = (/(zy) = q(z). Hence y = id g ( 2 ) which verifies that the action is free. 
The same can be proven for the left action under our assumption, but we do not need this fact. 
Finally, we need to check that we have a diffeomorphism X/Q(M) —> Y induced by the charge 
map p. We first check this for the groupoids T(M) and T(y), then we take the s-connected 
components which proves the assertion for the groupoid Q(M) and G(Y). We have to show 
that p{z) = p(w ) for z,w £ X if and only if there is a necessarily unique 77 £ Q{M ) such that 

w = z • 77 . Let z = (x',y, (A i) ie i), w = ( x',y , {yi)iei) and set y = (y,y, (a*) )• % definition 

of the topology of the groupoids fix the sequences (x' n ,y n ) such that p 3 ^ 1 ^ Aj, j £ /, n —> 00 

and (; x' n ,y n ) such that j el, n 00 . 

Then 77 £ T(M) since 


PiiVn) 

Vi{Vn) 


Qijx'n) f Qijx'n) 

PiiVn) \PiiVn) 


-1 


pi ■ _ T 
^ , l £ I, 

A 


n 


00. 


This concludes the proof of the isomorphism X/Q{M) = Y. Hence we obtain a bibundle 
correspondence and Axiom ii) is verified. Part iii) follows from the definition of the actions we 
just gave. Also note that the flip diffeomorphism f: X —y X 3 is defined by 


f: (x', y, (Aj)igj) 1 y x', ^ • 

It remains to verify condition iv). For this we define := G(X±) and prove that this groupoid 
has the required property. Thus we want to show that 


dregGt = X x , X £ X. 


The boundary is possibly empty (for x not incident to the hypersurface Y). We have to distin¬ 
guish two cases: x in the interior and x on the boundary of XI. The groupoid fiber G^r for x 
in the interior Mq trivializes to the pair groupoids and this case is thus immediate. We need to 
consider the case of a point on the boundary of M. Assume that x £ F for some open face F 
of XI which is incident to Y (i.e. shares a hyperface with Y). By the local triviality property of 
groupoids (see (2g|) we have 

Gt = F x R* + . 

The same follows by definition for X, i.e. 

Aj, ^ Fij x 

where F,\j denotes the face of F such that Fij = F C\Y. Via the definition of the Lie manifold 
with boundary (cf. j3|) we obtain that the component F x Ml is the interior of a manifold with 
boundary. In particular we see that 

d reg {F x r;) = d reg (F x r;) =* F ig x r;. 
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In summary, we obtain 


dregGx ~ < 


*0 

Fij x 


rv V 
— * 


for a; G Xo 

for x incident to some F 
otherwise 


Hence condition iv) holds. 


□ 


Remark 4.4. On the given Lie manifold with boundary we can always restrict the groupoid 
Q integrating the Lie structure 2V to a small tubular neighborhood Y GU C M such that the 
faces of Y are in bijective correspondence with the faces of U as specified in the introduction. 
Then it is not hard to verify that there is a bibundle correspondence between Gy = Gd and G 
implemented by X = r~ l (Y), X t = s - 1 (y). Condition Hi) follows since Gm 0 — A/q x Mq by 
assumption. Also setting G ± = Gx we see that condition i) holds. By the previous proof we also 
obtain that condition iv) holds whenever the groupoid Q is locally trivial. Therefore there is in 
fact a boundary structure for any Lie manifold with boundary for which there is an integrating 
groupoid with the local triviality property. 


5. Operators on groupoids 


The next goal is to define potential, trace and singular Green operators on the groupoid level. 
These operators should be equivariant families of operators on the fibers, similar to the case of 
pseudodifferential operators on groupoids. The singular Green, trace and potential operators 
are ordinarily defined so as to act like pseudodifferential operators in the cotangent direction 
and as convolution operators in the normal direction. This somewhat complicated behaviour is 
difficult to realize in the groupoid setting. We start from a different but equivalent definition. 
Our approach is inspired by the ordinary case of a smooth, compact manifold with boundary, cf. 

14]. Here the trace, potential and singular Green operators are extended to the double of the 
manifold and can be understood as conormal distributions with rapid decay along the normal 
direction. In our general setting we would therefore like to consider conormal distributions on 
Y x M and M x Y as well as M x M. Since we are working in the setting of manifolds with 
corners we will desingularize these manifolds using Lie groupoids. This is where the previously 
introduced notion of a boundary structure enters. For the cases of M x M and Y x Y this is 
realized through the groupoids Q and Go respectively and the pseudodifferential operators on 
groupoids. We introduce additional blowups X and X f with good properties (fibered over the 
manifolds Y and M ) with regard to Q and Go- Then we define the trace, potential and singular 
Green operators as distributions on these spaces and G conormal to the diagonal Ay. 


5.1. Actions 

From now on we fix: A boundary structure (Q, Go, G±, X, X t , f) adapted to our Lie 
manifold ( X , V) with boundary Y and its double (M, 2V). We then fix the groupoid actions 
which are summarized in the following picture. In the first column the dotted arrows indicate 
morphisms in the category of Lie groupoids (correspondences) which are implemented by the 
actions in the second column. 


Go > G > Go 

O O O Q 
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Fix also Haar systems on the groupoids and fibered spaces as follows. 

Q • {^x}x(E:Mi 

Gd ■ {hy}y£Y, ■ {A ijxeM- 

In each case the system is a (left / right)-Haar system if the corresponding action is a (left / 
right)-action. 


5.2. Local charts 

In order to define the operators on groupoids and actions as given in the last section we have to 
introducethe local charts. The charts are given by diffeomorphisms which preserve the s-fibers, 
see also 


m, p- 3 . 


Fix the dimensions n = dimM = dim Mg, n — 1 = dirnY = dim To. 


• A chart of Q is an open subset Ll C Q which is diffeomorphic to two open subsets of xK". 
Choose two open subsets V s x W s and V r x W r . Then choose two diffeomorphisms ip s : Ll —> 
V s x W s and if r : LI —> V r x W r . Additionally, we require that these diffeomorphisms are 
fiber-preserving in the sense that sftp s (x, w)) = x for (x, w) G V s X W s and r('tp r (x, w)) = x 
for (x,w) G V r x W r . Hence we have the following commuting diagrams: 


r(H) x W r — n s{n) x W s 


V r <~ 


■r(Q) 


s (n) 




Similarly, the charts for X are given by the sets of the form H n X for charts of Q 
fitting into the following commuting diagrams: 


V q X Wg + 



Wq <r- 


■m 


^ V p t x W p t 


p\Ll) 



Analogously, !lcT are charts with the actions reversed and hence in this case we have 
the commuting diagrams: 


Wp<- 


V p xWp< 



■ p(n) 


» V q t X W q t 


q\Q) 


V q t 


Definition 5.1. i) A family T = (T x ) x& m of operators T x : Cf°(Q x ) —> Cff(X x ) is a differentiable 
family of trace type iff the following holds. Given any chart Ll C Q with fiber preserving 
diffeomorphism, s(H) ~ x W for some W C K n open. Moreover for H := II n X such 
that W := W D M n_1 we have a fiber-preserving diffeomorphism q(Cl) ~!lx W, and for each 
< p G (p G the operator (pTip has a Schwartz kernel 

k G I m (s(H) x IT x W,A W ) = x W,A W ). 
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The operator (pT x (p for each x € s(f2) corresponds to the Schwartz kernel k x via the diffeomor- 
phisms X x n fl = W and Q x fl fl = W. 

ii) Analogously, we define a family K = (K x ) xG m of operators K: C£°(X*) Cf°(Q x ) with the 
charts reversed. This is called differentiable family of potential type. 

in) A differentiable family of singular Green type ( G x ) x£ m is a family of operators G x : Cf°(Q x ) —> 
Cf°(G x ) defined as follows. Given any chart fl C Q with fiber preserving diffeomorphism 
s(D) ~ fl x W for some W C M n open and W = W fl M n_1 . Then for each € Cf°(fl) 
the operator ipGip has a Schwartz kernel 

k € I m (s(D) xWxW, A w ) = C°°(s(fi))®/ m (lT x W, A^). 

Furthermore, (pG x tp for each x G s(17) corresponds to the Schwartz kernel k x via the diffeomor¬ 
phism Q x fl fl = W. 

Fix the following operations 


/ig : Q x Q G , (7, r)) ^ 777 \ 
/i:fx6->f’,(z,7)4Z' 7 -1 , 
pf: Q x X 1 — > X, (7, z) i-)- 7 _1 • 2: 


whenever defined. 

A trace type family T has a family of Schwartz kernels (k^)) x ^M- Define the support of T as 

supp(T) = |J supp(fcj). 

x£M 


The reduced support of T is written 


supp^T) = ^(supp(T)). 

The analogous definitions for potential type operators K and Green type operators G are given 
by 

supp ^{K) = ^(supp (K)), supp ^(G) = /ig(supp(G)). 

Definition 5.2. • An extended trace operator is a differentiable family T = (T x ) x& m of 

trace type which is a right ff-operator (see Definition 13.71 p. flOl) such that the reduced 
support of T is a compact subset of X. 

• An extended potential operator is a differentiable family K = (K x ) xG m of potential type 
which is a left ^-operator such that the reduced support of K is a compact subset of X. 

• An extended singular Green operator is a differentiable family G = (G x ) x ^m of singular 
Green type which is equivariant and such that the reduced support of G is a compact 
subset of Q. 

Remark 5.3. i) Since we also have a right action of Q on X and X is diffeomorphic (via f) 
to X 1 we obtain that being a left ^-operator is equivalent to the equivariance condition with 
regard to the right action of Q on X given in equation ([5]) on p. [9j Hence a potential operator 
is also a right operator with regard to X in this sense, which furnishes by the proof of Prop. 13.81 
a reduced kernel for extended potential operators. 

ii) Note that we obtain the reduced kernels for pseudodifferential operators on Q and extended 
singular Green operators with an argument completely analogous to the proof of Prop. 13.81 


17 



Proposition 5.4. i) Given an extended trace operator T the reduced kernel k y (see Proposition 
(EH), P- 1 1 01) is a compactly supported distribution on X conormal to Ay. 

ii) Analogously an extended potential operator K has reduced kernel kx a compactly supported 
distribution on X 1 conormal to Ay. Furthermore, I\ is the adjoint of an extended trace operator. 

iii) An extended singular Green operator G has a reduced kernel kc being a compactly supported 
distribution on Q conormal to Ay. 

Proof. We give a proof of conormality for the case i) of extended trace operators. The other 
cases are the same. 

Given a family of Schwartz kernels for (k x ) x ^M contained in P n (X x x Q x . X x ) for each x £ M. 
Rewrite this as 

k x = F*( k T)\x x xg x , Xx C Q x (transversal). 

Here p is the map X * Q 3 (z, 7 ) 1-7 z ■ 7 -1 £ X and 


{n*(k T )J) = /k T {z), f f(w, 7 )\. 

\ Jw=z -7 / 

Then we need to show that: singsupp(fcy) Cf = Ay. 

To this end let z £ X \ Ay and ip £ Cf°(X) a cutoff function such that <p is equal to 1 in a 
neighborhood of Ay and equal to 0 in a neighborhood containing 2 . Then 


M*((l - <p)kr) = (l-tpo y)n*(k T ) 


restricted to X x x Q x yields (1 — ip o fi)k x and this is C°° because singsupp(fcj) C A x = X x C 
X x X Q x by definition. Hence (1 — 7)0 /r)/r*(fcy) is C°°, but this implies that (1 — ip)kx is smooth 
as well. This proves cononnality. 

Finally, we show that a trace operator is the adjoint of a potential operator and vice versa. Let 
T = (T x ) xG m be an extended trace operator and let (k x ) x& M be the corresponding family of 
Schwartz kernels. The adjoint T* = (Tf) x& M is given by T*: Cf°(X x ) —y C£°(Q X ) such that for 
u £ Cf°(X x ) we have 


( T »(7) = / k^(z,'y)u(z)dX s ^(z). 

Jx s( 7 ) 


Dehne the family of operators K = ( K x ) x£ m by K = T* and k x (j,z) := k x (z, 7 ). We obtain a 
family {k x ) x ^M of distributions on Q x x X x conormal to A x = X x for each x £ M . In addition 
K is equivariant with regard to the right action of Q which is by remark [5]3] equivalent to being 
a left Thoperator. Hence K is an extended potential operator. The same argument shows that 
the adjoint of an extended potential operator is an extended trace operator. □ 


Notation 5.5. We fix the notation for the reduced kernels and denote by /” l (T, Ay) the space 
of reduced kernels of extended trace operators of order m, by Iff l {X t ,Ay) the reduced kernels 
of extended potential operators of order m and by /™(<7,Ay) the space of reduced kernels of 
singular Green operators of order m. For the pseudodifferential operators on Q of order m we use 
the notation 4 > m (Q ) for the space of operators and I™(G, Am) for the reduced kernels. With the 
Schwartz kernel theorem it can be proven that the spaces T m (^) and I™(G, Am) are isomorphic, 


see 


30], p. 24. 


Remark 5.6. We will also use the notation 


^ m ’°(Q, Go) ■= Jtr o i:\X, Ay), Go) := J P ot o I™(X\ Ay), 

G m '\G,G d ) := J gr o I™(G, Ay) 
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for these classes of extended trace, potential and singular Green operators, respectively. The J. 
in each case are the appropriate isomorphisms from the Schwartz kernel theorem. 

Hence the operators defined previously act as follows. The mapping 


Jtr : JT(*,Ay) Sr m '\Q,Qa) C Hom(C“(6),C c “(T)) 

is for z £ A, hr £ 7™ (A, Ay) given by 

(Jtr(k T )u)(z) = / k T (z •7 _1 )«(7)^< ? G)(7)- 

Analogously for the potential operators we have 

Jpof- 4 m (^,A r ) ->• /C m ’°(<?,<5 a ) c Horn (C^iX^C^g)) 
which for 7 G 6, kj< £ I™(A 4 , Ay) is given by 

(. J P ot(k K )u){n ) = / • z)u{z)d\ t r ,,Jz). 

Jx*. , 

r(7) 

Lastly, for the singular Green operators 


J, r : I™(G, Ay) -7 G m '°(G,G a ) c Hom(C ')? 0 {G),C%°(G)) 
we have for 7 £ C?, fee £ !™{G, Ay) 

{Jgr{k G )u){ 7)= / fc G (77 _1 )u(r ? )(i^ s ( 7 )(r?). 

J 


With any fibered space, longitudinally smooth via an action of a nice enough groupoid one 
can associate an equivariant calculus of pseudodifferential operators. We want to define such 
a calculus on A and A 4 . The following definition can in somewhat greater generality also be 
found in 


m- 


Definition 5.7. A family of pseudodifferential operators of order m on A is defined as S = 
(S x ) xeM such that 

i) each S x : C°°(X x ) -a- C°°(X x ) is contained in ^ m (X x ). 

ii) For each chart of A given by H ~ q(Q) x W there is a smooth function a: q(£l) —>• S m (T*W ) 
such that for each x £ g(fl) we have 


£>x\Q.c\X x — a x{y 1 Dy) 

via identifying Q n X x with W. Here a x (y,£) = a(x)(y,£). We denote by 'F m (A) the set of 
pseudodifferential families on A. 

This leads immediately to a definition of equivariant pseudodifferential operators on A and A 4 . 

Definition 5.8. The space of equivariant pseudodifferential operators T*(A)^ on A consists of 
elements S = (S x ) x£ m of 'F*(A) such that the following equivariance condition holds 

R,' y— iSyfiy'jRj'y 7 £ G‘ 

By analogy we define the equivariant pseudodifferential operators ^T*(A 4 ) on A 4 coming from 
the left action of G • The equivariance condition in this case is given as in Definition 13.7) ii) on 

P . m 
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The operators defined here are in each case families parametrized over the double M. We have 
to clarify what role the pseudodifferential operators defined on Gg play. 

Proposition 5.9. We have the following exact sequence 

1Z S 

C^{M)^P(X) S > -> ^ W(G d ) 

where IZy is a well-defined restriction of families (S x ) x£ m ^ {S y )x& r - Here Cy(M) are the 
smooth functions on M that vanish on Y. 

Proof. First note that Gg acts (from the left and the right) on itself. Extend this action to 
the set of families ( S y ) ye y with S y £ SP*((Gg) y ). Invariance under this action is just the usual 
equivariance condition for pseudodifferential operators. Together with the uniform support 
condition we therefore recover the class of pseudo differential operators, denoted It* (Go)- 
The exactness of the sequence 

Cy(M)^>*(X)> -> V(X) -%• ^*(X {Y ) 

for the restriction operator IZy defined by 'TZy((S x )x&m) = {S y )yeY is immediate. Here note 
that 

X\Y = q-\Y) = r~\Y) D ^(T) = # = Qg 

by assumption. 

Note also that by the previous remarks ^*(X\y> y — This furnishes the exact sequence 

of equivariant pseudodifferential operators with a well-defined restriction map IZy 

Cffi(M)^ 9 (X) G > -r y(X) G W(X\ yfr =* V*(g d ). 


□ 


6. Compositions 

In order to prove the main Theorem we first establish a Lemma about compositions of conormal 
distributions. 

Lemma 6.1. The classes of extended Boutet de Monvel operators are closed under compositions 
induced by groupoid actions and convolution. More precisely we have the following compositions: 


*: ^(Xfi Ay) x Iff 12 (X, Ay) -»■ I™ 1+m2 (G, Ay), (6) 

*: / c mi (L,A y ) x If l2 (X t , Ay) -»■ V mi+m 2 (X) g , (7) 

*: r‘(L) 5 x I™ 2 (X, Ay) -)■ I™ 1 +m 2 (X, Ay), (8) 

*: (G) X If 12 (G, Ay) -> I^ +m2 (G, Ay), ( 9 ) 

*: I^{G,A y ) x V m 2 {G) -> I™ 1 +m 2 {G, A y ), ( 10 ) 

*: 7 c mi (£,Ay) x I^ 2 {X\A y ) -> I ™ 1+m2 (X f , A Y ), (11) 

*: I^{X, Ay) x V m 2 {G) -i I™ 1 +m 2 (X, A y ), (12) 

*: * mi (G) X If 12 (X 1 , Ay) -> Iffi 1+m2 (X t ,A Y ), (13) 

*: Iff 11 [X*, Ay) x e * m *(X t ) -> I^ 1 +m 2 (X t , Ay), (14) 

*: Iff 1 {X, Ay) x I™ 2 {G,A y ) -> I™ 1 +m 2 (X, Ay). (15) 
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Proof. We have the equivalences (fl3l) 77 (fl2l) . (HU) 77 d 8 |) and (USD 77 (fTTT) by Prop. 15.41 ii). 
Since the argument in each case goes along the same lines we only treat the first 3 cases of 
compositions exemplarily. 

i) We consider first the case of the composition ([ 6 ]) . Consider a family of extended trace operators 
T = (T x ) x£ m and extended potential operators K = (K x ) xG m- Denote the corresponding family 
of Schwartz kernels by k x £ I mi (X x x G x ,X x ) as well as k x £ I m 2 (G x x T*, A*) for x £ M. 

We make the following computation involving an interchange of integration we still have to 
justify via a reduction to local coordinates. Let 7 £ G x then 


(I< x • T x )u(i) = [ k*f ( 7 , z)(T x u){z) dX x (z) 

= / k^('y,z)k^(z,r])u(r])dn x (r])dX t x (z) 

= /»r(7„ MM). 

« Gnr. 


The kernels of the composition k x ' T would therefore take the form 


k x ' T (.l,v)= [ k^(-f,z)kl(z,r])dX t x (z). 


This corresponds to the convolution of reduced kernels kx * kx which is immediately defined 
from the actions. 

First we check the support condition of the composed operator. The reduced support is compact 
via the inclusion 

supp ^{K ■ T ) C /xg(supp X {K) x supp A t(T)). 

Here the inversion of elements in the spaces X and X t is performed inside the groupoid G where 
it is always defined. 

Fix the projections 

Pi: X x G —7 X, P 2 ■ X x G —G ■ 

Then by the uniform support condition the family T = (T x : x £ M ) is in particular properly 
supported. This means for compact sets I\\ C G, K 2 C X we have that 


Pi 1 (K i ) n supper) C X x G,i = 1,2 


is compact. We make use of this property for the following argument. 

Next we check the smoothness property of compositions. Let / £ C£°(G) be given, we will show 
that Tf £ Cf°(X). Assume that T = (T x : x £ M ) has a Schwartz kernel kx contained in 
I~°°(X, Ay) = f] m I m (X, Ay). Then kr is C°° on the closed subset {(z, 7 ) : q(z) = s( 7 )} of 
X x G and via fiber preserving diffeomorphisms we obtain a C'°°-atlas. The function Tf yields 
a smooth function because we integrate the kernels k x which are smooth functions. Hence we 
can interchange integration and differentiation. Therefore Tf £ C£°(X) for kx £ I~°°(X, Ay). 
Consider a general extended trace operator T. Let ( 7 , z) £ G x x X x and H C G be a chart 
with fiber preserving diffeomorphism H ~ s(H) x W. We can assume that W C M n is convex, 
open, 0 £ W and that H is a neighborhood of 7 such that (x, 0) gets mapped to 7 via the 
diffeomorphism. We also set Cl = H n X C X and W = W PI M Tl ^ 1 with a fiber preserving 
diffeomorphism Cl ~ q(Cl) x W (recall the fact that q = s^gv by assumption). By the previous 
remarks the family T is properly supported, which implies in particular that each T x is properly 
supported for x £ M. Hence we obtain that the kernels k x of T satisfy the support estimate 

pf 1 x ^ n pf 1 x n|jsupp(/cj) C x x x 
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therefore the fact that Tf E C%°(? h) reduces to a computation in local coordinates. 

Similar reasoning applies to potential operators. Using the same argument as above we deduce 
that Kf E C£°(Q) for / E C£°(X) if K is smoothing. For a general K we note that each K x is 
properly supported for x E M and hence we obtain that the kernels k x of K satisfy the support 
estimate 

3W \ 

x- • 

2 J 

The smoothness of Kf reduces to a computation in local coordinates. Consider the general 
composition K ■ T for T an arbitrary extended trace operator and K an arbitrary extended 
potential operator. Then make the suitable support estimates as above to show that K x ■ T x are 
compositions of smooth families of conormal distributions which act on the sets W C M n , W C 
M” . It then follows from a general theorem of Hormander about compositions of conormal 
distributions, see 0 , Thm. 25.2.3, p. 21 that the composition T ■K yields a family of operators 
each of which is a conormal distribution in the sense of Definition 15.11 Hi). 

We therefore obtain a properly supported family K T which is by the above argument uniformly 
supported since K and T are each uniformly supported. Finally, we check the equivariance 
property for the new family of operators G = K ■ T. Since (i ? 7 ) _1 = R^-i we can write the 
equivariance condition from Definition 13.71 in the form 


W 


Pi U(n) x — D p 2 


-l 


W\ r - ;-— 

s(^) x y) n U supp (^) c 

/ nr 


m x ^ 


s(D) 


r r ( 7 )i ? 7 = i? 7 r s ( 7 ), v 7 e Q. 

Since K is equivariant with regard to the right action of Q on X by Remark 15.31 i), the equiv¬ 
ariance condition for K reads 


Ry —l ^^r( 7 ) Rs{y)Ry 7 V ^ G 


For 7 E Q we calculate 


R-y 1 ( H * 1 ^ ^ (7) 7 P^y 1 (" IPrp ^ 7 ^ * 2 'rj. ^y j ^ Ry PIy 1 ]X Ry 2 ^ 

y'jRy — 1 ' RyTs^) R-s(y) ((Ry) ‘ Ry ) T s ( 7 ) -^ 3 ( 7 ) " -^ 5 ( 7 ) 

= (K-T) s{ y ) 


and hence K ■ T has the required equivariance property with regard to the right action of the 
groupoid Q. We have thus verified all the properties of an extended Green operator. 
ii) Consider the next composition T ■ K: C%°(X) —>• C£°(X) which is again for z E X and 
u E C%°(X) given by 


{T x ■ K x )u(z ) = f k R {z, 7 )(A" x -u)( 7 ) dfi x ( 7 ) 

•>Qq(z) 

= / k^(z,'r)k^('y,w)u(w)d\ t x (w)dfi x ('y) 

Jg* -lx* 

= / kl' R (z,w)u(w)d\ t x (w). 

Jxi 


The kernel k RK is written 


k x ' K (z,w)= / k R (z,'y)k R ('y,w)dii x ('y). 

<2 Gcr. 
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Now we can argue again analogously to i) that the composition has the right support condition 
and via a reduction to local charts the formal computation can be made precise. We therefore 
obtain a family of kernels k x ' K £ I mi+rn2 (X). x X x ,Ax x )- 

in) The third composition S T: C£°(G) —> C^°(X) gives a family of extended trace operators. 
We obtain for z £ X, u <E C^{Q) 


(S x ■ T x )u(z) = / k x (z, w)(T x ii)(w) dX x (w) 


>x x 


f k s x (z,w)k T x {w, 7 )u( 7 ) d Mx ( 7 ) d\ x (w) 

** G:r. 


JX X Jg. 

= / k^ T (z, 7 )u( 7 )dfi x { 7 ). 
J Qx 


We obtain the kernel 

k x T (z, 7 ) = / k x (z,w)k x (w, 7 )d\ x (w). 

Jx x 

We proceed by making the analogous argument as in i), ii). The right support condition holds 
on ty(X) G e.g. via the identification from 15.91 The rest of the reasoning then yields a family of 
kernels k x ' T € I mi+m2 (X x x Q x ,Ax x ) with the correct support condition. □ 


7. The calculus 

7.1. Quantization 

Let us denote by B™7op{Mq, T 0 ) the properly supported extended Boutet de Monvel operators of 
order m, defined on the interior. In this section we introduce an algebra of extended operators 
£> 2 y (Ad, Y) on the double Lie manifold M. This is defined by extending the distributional 
kernels in Bprop (Mg, Yq) to take the Lie structure into account. We also fix the actions with 
corresponding notation from l5.ll Introduce the singular normal bundles for the inclusions Ay 
X, Ay X 1 as well as Ay Q: 

M x A y -> Y, M xt Ay y, M g Ay -»• Y. 

Restricted to the interior we have by axiom in) in Def. 14. II the isomorphisms 

M x A y \y 0 = N Y ° x M ° Ay 0 , M xt A y \y 0 = N MoxYo Ay 0 , M g A y \y 0 = N MoxMo Ay 0 . (16) 

Here we denote by N Y ° xM ° Ay 0 the normal bundle to the inclusion Ay 0 ^ Lo x Mo and the same 
for the others. It is not hard to see that J\f x A y can be identihed with A\y which is isomorphic 
to Ag © A/". 

Remark 7.1. i) On the singular normal bundles we define the Hormander symbols spaces 
S m (Af x Ay) c C°°(J\f x Ay) such that for U C Y open with 

M x A\-\u = U x M n_1 xR, K dU compact. 

We have the estimates for t € S m (Af x Ay) 

\D%DP^ n t(x',£)\ < C K , a>fi (Z) m -W, (x,0 G K x R n_1 x R 

for each a £ Nq^ 1 , j3 £ Nq . Note that we have by Hormander’s results a correspondence between 
the spaces of symbols on the normal bundle to a smooth manifold and conormal distributions 
on the space (at least in the smooth case, cf. 0, Thm 18.2.11): 

I l (X,Ay)/I~°°(X,Ay) = S m (Af x A*y)/S-°°(Af x A*y) 
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where L is the obligatory correction of order 

m = L -dim X -t — dim Ay. 

4 2 

We will ignore this order convention in the following discussions. Note that our earlier defini¬ 
tion of smooth families of operators defined as conormal distributions suggests immediately a 
quantization which we state next. We can require additionally the (local) rapid decay property 
stated earlier, then we use the notation S'Jf{N x Ay) for these symbol spaces. Analogously the 
spaces 

S%(Af xt Ap) c C°°{M xt A* y ), Sf}{Af g A* Y ) c C^A/^AC-). 

ii) A second definition we will need is that of conormal distributions on the normal bundles 
themselves. First given the normal and conormal bundles 

7r: M x A y —>• Y, 7T: Af x * A* Y ->■ Y, 

(and analogously for A f x , A f G ) define the fiberwise Fourier transform T {: S(Af x Ay) —> S(Af x Ay) 

^(v)(0 := [ e-^VtOdC. 

J7r(C)=7r(0 

The inverse is given by duality 




' 7r (0 =7r (0 


e i<c ’ c V(0^. F G S(Af x Ay) 


Here we use the notation S(J\f x Ay), S(JV x Ay) for the spaces of rapidly decreasing functions 
on the normal and conormal bundle respectively, see also 
conormal distributions are defined as: 


351 ]. chapter 1.5. Then the spaces of 


I m (M x Ay, Ay) := Ff 1 S m (Af x Ay) 
and I m (N xt Ay,Y), I m (J\f G Ay,Y) analogously. 

For the definition of the quantization rule we need some further notation. Let 0 < r < ro where 
ro is the (positive) injectivity radius of M. 

• First for the case of trace operators. We set 

(Af x Ay) r = {u € M x Ay : ||u|| < r} 

as well as 

I$(M X Ay,Ay) = I m ((Af X Ay) r ,Ay). 

Fix the restriction 


n ; I^(Af X Ay,Ay) ^ I$(N Y ° xM °Ay 0 ,Ay 0 ). 

We denote by *F the normal fibration of the inclusion Ay 0 ^ Yq x Mq such that ’ll is the local 
diffeomorphism mapping an open neighborhood of the zero section Oy 0 C V C N Y ° xM ° Ay 0 
onto an open neighborhood Ay 0 C U C To x Mq (cf. [35J], Thm. 4.1.1). Then we have the 
induced map on conormal distributions 

T* : I$(N y ° xM °Ay 0 ,A Yo ) I m (Y 0 x M 0 , Ay 0 ). 

Also let x € C™(N x Ay) be a cutoff function which acts by multiplication 

I m (J\f X Ay, Ay) I^(Af X Ay, Ay). 
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• For potential operators we use the analogous notation: 

n\ ¥, 7), x*. 


• Finally, in the singular Green case we have the induced normal hbration 
$*: /™(IV M ° xM °Ay 0 , Ay 0 ) -)• I m (M 0 x M 0 , Ay 0 ). 
and the fiberwise Fourier transform 

I m (Af G A Y , A r ) -»■ S' 7 " (A / -0 Ay). 

The restriction and cutoff is denoted by 

Al 0 : I^(Af G Ay,A Y ) -> I^ ) (N M ° xM °A Yo , A Yq ) 

and 

<p: I m (M g A y ,A y ) ->• /^(A^Ay, Ay). 
Definition 7.2 (Quantization), i) Define 

g T , x : S m (Af X Ay) -> 
such that for t <G S m {M x Ay) we have 

9T,x(*) = Jtr ° <34>,x(0 

where 

^, x (t) = ^(7e(x^r 1 (t))). 

ii) Define 

: S m {J\f Xt Ay) -> JC' n (M,Y) 
such that for k € S m (Af xt Ay) we have 

Qk,x t (ty ffpot ° (fi) • 

m) Define 

S'™ (A/ -0 Ay) Y) 

such that for g <G S m (N G Ay) we have 

QG,<p{d) = Jpot ° Q^,ip{d)- 


Proposition 7.3. The fibrations qy, x , q^t^t and q$ tip define properly supported Schwartz ker¬ 
nels. 

Proof. Consider exemplarily the trace operators. Since x7£(t) is properly supported we find that 
QT,x(t) defines a properly supported operator. It is clear from the definition that qr,x(t) '■ Cf°(Mo) —» 
C c °°(y 0 ) has the Schwartz kernel g^ ;X (t). □ 

The following is easy to check. 

Proposition 7.4. The quantizations qr, x - Qk.xi QG,x are eac/i case independent of the choice 
of cutoff functions up to smoothing errors. 
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From the compactness of M and Y we can associate to each vector field in 2V respectively W 
a global flow 

2V 3 V <h y : M x M -x M, 

Then consider the diffeomorphisms evaluated at time t = 1 

$(1, -): M ->■ M and (1, -)\Y ->Y 

and fix the corresponding group actions on functions which we denote by 

2V3V^p v : C°°(M) -> C°°(M), 

C°°(Y) -> C°°(y). 

The upshot of this is a definition of the suitable smoothing terms for our calculus which we state 
next. 

Definition 7.5. i) The class of V-trace operators is defined as 

3T™'°(M,Y) := ^ m ’°(M,y) + ^ 2 ~°°’ 0 (M,Y). 

Here £7" m ’°(M,Y) consists of the extended operators from the previous definition. The residual 
class is defined as follows 

•V°>°(M, Y) := span .{q x>T (t)'p Vl ■■■<Pv k : Vj G 2V, X € C?{Ae), t € V°(A^A^)}. 
ii ) The class of V-potential operators is defined in the same fashion 

Y) := K7 n (M, Y) + Y) 

with residual class 

JC~™(M,Y) := sp a n{q XtK (k)^ Wl :Wj €W, C?(Aa), k € 

Hi) Lastly, the class of V-singular Green operators is defined as 

Y) := Y) + 0- v °°’ o (M, T) 

with residual class 

^^(M,y) := span{ (?x , G ( ff )^y 1 ■ ■ ■ Yv fc : Vj € 2V, X € C^Ma), g € 
iv) Then the calculus Y) of extended operators consists of matrices of the form 


A = 


P + G K\ 
T SJ 


for P £ \IdJy(M), 5 € T^y(y) and G an extended singular Green operator, iL extended potential 
and T extended trace operator. 
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7.2. Composition 

The restriction x + to the interior Xq := Xq \ Yq and the extension by zero operator are given 
on the manifold level by 


L 2 {Mq) <—— L 2 (Xo) 
x u 


with x + X° = id L 2 (^- 0 ) and x°X + being a projection onto a subspace of L 2 (Mq). 

On the groupoid level we use the same symbols since it will be clear from context which is 
meant. So we define the operators 


x + 

L 2 (G)^^L 2 (G+) 

x 

with x + X° = id-L 2 (e+) and x°X + being a projection onto a subspace of L 2 {G)- 

Definition 7.6. The operator P £ *1 ,m (G) has the transmission property if the symbol a £ 
S™(A*). Here the class of Hormander symbols a £ S™(A*) consists of families a = ( a x ) x& M 
such that each symbol a x has the transmission property with regard to X x C G x - In particular 
the operators (x + T > \'°) a . map functions smooth up to the boundary X x to functions which have 
the same property. 

Example 7.7 . • Notice first that if x £ Mq is an interior point we have that G x — Mq and 

we recover the transmission property on the interior manifold Xq with boundary Yq. 


• In our trivial case G = M x M and M = 2X , X a compact manifold with boundary 
dX = Y we recover the transmission property meaning T™(M) = T™(C/). 


Notation 7.8. The operation of truncation itself is given as a linear operator. 
i) On the groupoid calculus this operator is given by 


End 


D B m ’°(G,X) bA = 


'CT(G) 

,C?(X) 

ii) On the extended calculus we define 


P + G K 


i y C(A) = 


X + (P + G)x° 

T X ° 


End 




P + G K 
S 


i ^ C{A) = 


X+(P + G) X ° 

T X ° 


X + I<\ 

S J 


£ End 


(CT(Q + )\ 

\CT(x)J 


x + k\ 

S J 


£ End 


(C?(X 0 ) 


Definition 7.9. i) The Boutet de Monvel calculus on the boundary structure is defined as the 
set of operators for m < 0 

B m ’°(G + ,X) := C O B m ’°(G, x). 

ii) The class of Boutet de Monvel operators on the Lie manifold with boundary is for m < 0 
defined as 

Y):=C o Y). 

The vector representation qbm is defined by 


©M;) 

for A £ B m ’°(G + , X) and ip £ C c °°(X 0 ), ^ £ C™(Y 0 ). 

Proof (of Theorem II.111 . Let A,B£ B°'°(G + , X), then A = (A x ) xe x, B = ( B x ) x& x are 
equivariant families of properly supported Boutet de Monvel operators the fibers (G x , X x ) which 
are smooth manifolds with boundary. The composition A ■ B = (A x ■ B x ) x& x is on the fibers of 
the groupoids and the spaces X and X t . Using the support estimates in the proof of Lemma 
16.11 the calculation can be performed in local charts by reduction to composition of properly 
supported operators of Boutet de Monvel type on smooth manifolds. □ 
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7.3. Representation theorem 


Theorem 7.10. Given a V-boundary structure the previously defined vector representation qbm 
furnishes the isomorphism 




Proof. The proof is similar to the proof of Theorem 3.2. in [3]. For further details we also refer 
to Theorem 7.9]. □ 


Proof (of Thm. 11.21) . From the right action of the groupoid Q on X we obtain the induced 
action of the subgroupoid Q + C Q. The right action X\ x Q Q + defines the equivariance of the 
families in the calculus B 0,0 (Q + , X). The range and source maps in Q + are the restrictions of the 
range and source maps in Q, hence the representation qbm is well-defined. Thereby we obtain 
that the truncation maps are linear, equivariant maps and the following diagram commutes as 
linear operators 


Y ) ©- B m '°(G + , X) 

qbm 


B%)°(M,Y)±—-B m ’"(g,X) 


C 

m, 0 


Since C, C and qbm are surjective (by Theorem l7.10D we obtain the surjectivity of qbm as follows. 
Let B € By '°(X, Y) then by surjectivity of qbm and C we lift this to an element B € B m ’°(G , X). 
Then A := C(B) is the required preimage. By commutativity we have 


Qbm(A) = (qbm ° C){B) = (C o qbm){B) = B. 


Hence in this case qbm is surjective. It is also immediate that it is a well-defined homomorphism 
of algebras. This yields the closedness under composition. □ 

Vector bundles 

Up until now we have only considered scalar operators of Boutet de Monvel type. It does only 
require minor modifications to consider operators acting on smooth sections of smooth vector 
bundles, see also [30]. To this effect let E\, E 2 —> X be smooth vector bundles on X and J± —> Y 
smooth vector bundles on Y. We can pull back these bundles to Q + via Ei := r*Ei —> Q + . 
Similarly, the actions allow us to pull back the bundles J± to X and obtain J± —> X. 

It is not difficult to modify our construction for operators acting on the smooth sections such 
that A € By°(X, Y-, E\, E 2 , J±) is a continuous linear operator 

C°° {X, Ei ) C 00 {X,E 2 ) 

A: ® —> © 

c°°(y,j + ) c°°(y, j_) 

Similarly, A € B 0,0 (G + , X; Ei, J±) is a continuous linear operator 

C™(G + ,Ei) C™{G + ,E 2 ) 

A: ©->•©. 

C™(X,J + ) Cf°(X , J_) 
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8. Properties of the calculus 


The following sections mark the start of the analysis of the represented side of our calculus 
(the algebra By°(X,Y)). In order to limit the size of the paper and preserve its readability 
most proofs are referred to the comprehensive literature on Boutet de Monvel’s calculus, where 
these constructions have already been given and which need only be adapted to our setup in a 
straightforward manner. 

Set r(£) := (1 + ||£|| 2 ) 2 , then close to the boundary (in a fixed tubular neighborhood) we define 
the symbol 



for m £ M, some constant C > 0 and ip £ S'(M) such that <^(0) = 1, suppJ 7 1 p> C R_ 


Then r_(£) is an elliptic symbol and has the transmission property (cf. jl5l |. Proposition 1.3). 


We construct a global classical symbol a £ Sh(A*) as follows. Fix a normal cover (JWj Ui = M 
of M with local trivializations \kj: Au- — U x M n . 


• If Ui n Y = 0 (an interior chart ) set Tja(^) = r(£). 

• If Ui n Y / 0 (a boundary chart ) set \ELa(£) = r_(£). 

Definition 8.1. Let a £ S^iA*) be the order reducing symbol as defined above 


[q(a 


x'l-ll k 


for k chosen sufficiently large as in the proof of [d, Corollary 4.3]. 


We can use the same argument as in [15j, Proposition 1.7] to prove the following 
Proposition 8.2. The operator R + : x + R~X° extends to a linear isomorphism 


and set := 


result. 


R+: H$(X) H°T m (X) 

for each s € R. 

Denote by yy. C™(Mq) — > C£°(Yo) the restriction operator / i->- /]y 0 . Then yy: —> 

Hyy * (Y) is continuous for each m £ R, see Theorem 4.7]. We also fix the operator d £ 
Diff 2 y(M) which is supported in [0, e) x Y and near Y coincides with dt for t £ (—e, e). 

Lemma 8.3. For j £ No with s > j — ^ we obtain 

& + -.H^X)^H s v -\X) 


is continuous. 

Proof. The extension by zero operator y°: Hy(X) —> is a priori continuous for ^ > 

s > — Since any differential operator has the transmission property we obtain that is 
continuous for s > j — ^ by 15j, Theorem 1.14]. □ 

Definition 8.4. Set for a given / £ C°°(X) with support in Yu\ 

(7 jf)( x ') ■= Jim {dij)(x',t), (x',x n ) £ Y {e y 

Given u £ C%°(Yq) denote by u <g> Sy £ V(Mq) the distribution given by 

(u<S>6y,v) = (u, v(— ,0)) = [ u(x')v\ Yo (x') dv{x'), v £ C^°(M 0 ). 

Jy 0 
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Proposition 8.5. For s > j + ^ we have 


7 -j ■ H$(X) > h: 


S-J-r 

w 


(n 


is continuous. 


Proof. The differential operator 

d j : Hy(M) -7 H S V 3 (M) 

is continuous. Denote by e s : Hf,(X) —> i7| v (M) a continuous extension operator depending on 
s. By the previous remarks 

is continuous provided s > j — ~. In the fixed tubular neighborhood we can write 7 j = yyod 3 oe s . 
This proves the claim by the continuity of yy, d 3 and e s . □ 

We are now in a position to define the operators Y ) of arbitrary order m G R and type 

d G N 0 . 

Definition 8.6. i) A trace operator of order m G R and type d G No is defined as T G 
3?™' d (X, Y) if there is a sequence Tj G ^™~ 3 ’°(X, Y) such that 

r = Y T X 

j =0 

A residual trace operator of type d G No is defined in the same way for a sequence Tj G 
3r~°°’ 0 (X,Y), 0<j<d. 

ii) A singular Green operator of order m G R and type d G No is defined as G G £v’ d (^) if 
there is a sequence Gj G G™ 3,0 (X,Y) such that 

G = E G i 8 +• 

i=o 


A residual singular Green operator of type d G No is defined in the same way for a sequence 
Gj G Gy°°’°(X,Y), 0 <j<d. 

Remark 8.7. In [33], p. 149 we have the following standard representations for elements in 
Boutet de Monvel’s calculus. A trace operator T G Y) takes the form T = yy 0 Q+ for 

a Q G T™ vtr (M) and a potential operator K G JC™(X,Y) takes the form K = Q+(— <8> Sy) for 
a Q G We should remark that in our framework we can prove these properties in 

the same way. By an elementary but tedious computation we can show directly that the formal 
adjoint of a trace operator is a potential operator also in the order m > 0 cases. 

Theorem 8.8. i) A trace operator T G 3F™' d (X,Y) extends to a continuous linear operator 


T:HUX)^H s w m *(Y) 

for s > d — ^. 

ii) A potential operator K G K.™(X,Y) extends to a continuous linear operator 


K: 


s _i 

H 2 


on 


TTS — m 


(X) 
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for s > 

iii) A singular Green operator G € Qff’ d (X, Y ) extends to a continuous linear operator 

G: H$(X) ->■ H s v ~ m {X) 

for s > d — \. 

Proof, i) Let T G A^J l ' d {X,Y) and decompose T as follows 


T = T 0 + T d 


where T G 3F™'°(X, Y) and Tj can be written 


d -1 


Ti = Y S n- Sj e ^(F) 

3=0 


(see e.g. [34| for the proof). 

Hence the continuity follows from Proposition 18.51 

ii) This follows because K is the formal adjoint of a trace operator T. 

iii) By the same proof as in 3J], Lemma 2.2.14 we can write 


d-1 


G = J2 K w + G o, Kj G K.™~ j ’°(X, Y). 

3=0 

The first term on the right hand side is continuous by Proposition 18.51 and ii). The second term 
has the following series representation by [33], Lemma 7, p.149 


3 =1 


for a sequence of potential operators Kj and trace operators Tj. Hence the continuity follows 
by i) and ii). □ 


In the sequel we will study the corresponding Guillemin completion for Boutet de Monvel’s 
calculus. The completion has favorable algebraic properties. Most importantly, inverses (if they 
exist) are contained in the calculus. Define the completion £>y°°’ (X, Y) of the residual Boutet 

(HU*) H$(X)\ 

de Monvel operators with regard to the family of norms of operators L [ © , © 1 on 

WyCn Hw(Y)J 

Sobolev spaces. 

Definition 8.9. Let 

B%' d (X,Y) := B™’ d (X, Y) + B~°°’ d (X, Y) 
be the completed calculus of Boutet de Monvel operators. 

Proposition 8.10. Let R™ := X + R-X° with R™ G A>™ V (M) and R m G *™(Y) order reduc¬ 
tions in the pseudodifferential calculi. Define A m := diag (R™,R m ), then A m G B^’°(X,Y). 


Proposition 8.11. Let in < 0, then A G B™’°(X,Y) implies that A* G B™’°(X,Y) where 


fx + op( a )*X° + G* T*\ 

V K* S*J ' 
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Proof. We have [x + op(a)x°]* = x + °p( a )*X° immediately because m < 0 and L 2 -coritinuity. 
The adjoint of a trace operator is a potential operator and vice versa and the adjoint of a singular 
Green operator is a again a singular Green operator by definition. Finally, S* £ 'Fyy(y) since 
the Lie calculus is closed under adjoints, see [3|, Corollary 3.3]. □ 

For the following Theorem we use a common trick based on order reductions, see for example 
[§, Theorem 6.3.6]. 

Theorem 8.12. Let A E By’ d (X,Y) with d < m+. 

i) With m < 0 and d = 0 it follows that 

A ■ A* £ B^ m ’°(X,Y). 

ii) For m > 0 it follows that 

(A ■ A~ m ) • (A ■ A~ m )* E B°’°(X, Y). 

iii) If A £ By' d (X,Y) is invertible for some s > m as an operator 

Hy(X, E) H^~ m (X,E) 

A: © -»■ © 

H S w h (Y ) H s w m -hY,F) 

then the inverse A 1 £ B v (X, Y ). 

Proof. The properties i) and ii) follow immediately from Proposition 18.111 In order to prove 
iii) we consider the pseudodifferential order reductions 

Rf s : L 2 v (X, E) © Hj (Y, F ) ©V H$(X, E) 0 (T, F) 

and 

RS . m . H s-m^ E) e H ^~\ (y> F) ^ 4 (X) E) © H J (y; F). 
of order —s and s — m respectively. 

Then 1? := R s 2 ~ m ARf s is contained in (X, T) and is invertible. Therefore the assertion 
reduces to the order (0,0) case. We apply the T*-property of the (0,0)-algebra which is proved 
analogously to 0, Theorems 6 .1-6.2] and 0, Lemma 4.8]. □ 

9. Parametrix 

In this section we will introduce the principal and principal boundary symbol of an operator in 
our calculus. We will define the notion of ellipticity and show that a parametrix exists under 
the previously stated conditions on the calculus. A major technical problem is that in the Lie 
calculus already inverses of invertible operators are not necessarily contained. This makes a 
parametrix construction difficult and we state here a version of such a result. There are at least 
two approaches to overcome the problem of inverses: (1) using a larger calculus of pseudodiffer¬ 
ential operators (with asymptotics) or (2) completing the algebra of pseudodifferential operators 
(non-canonically) such that inverses are contained. In the last section we outlined the second 
approach. We will henceforth consider the completed Boutet de Monvel calculus as defined in 
Section 0 

Fix the smooth, hermitian vector bundles E\ , E 2 —>• X, J± —> Y and recall the notation for the 
boundary algebroid and its co-bundle ttq : Aq Y, ng: A*g —> Y. 

We define the principal symbol and principal boundary symbol on B m,0 (Q + , Af ; E\, E 2 , J±) for 

m < 0 . 
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• Set T q X := ker dq for the vertical tangent bundle over X. 

• Let A = (A x ) x ex £ B m, 0 (G + , X) be a C°°-family of Boutet de Monvel operators. 

• Then for each x £ X we have a Boutet de Monvel operator A x £ B™ r o P {G x , %x)- 

• Hence the principal symbol <j{A x ) and the principal boundary symbol ag(A x ) are defined 
invariantly on T*Q X and T*X x respectively. 

• By right-invariance of the family A these symbols descend to a principal symbol a (A) and 
principal boundary symbol erg (A) defined invariantly on A* + and (T q X)* respectively. 

• Introduce the indicial symbol TZp for a face F £ Fi(X) as the restriction TZf((A x ) x€ x) = 

(Ay)y£F- 

By noting that TEX = Ag we make the following definition for principal and principal boundary 
symbol on the represented algebra By’°(X, Y ) for m < 0. 

Definition 9.1. To an element A £ B™’°(X, Y ; E\,E 2 , J±) we associate the two principal sym¬ 
bols. 

i) The principal boundary symbol <Jq (A) is defined as 

a d( A ) ■= cfq\y{A). 

This yields a section of the infinite dimensional bundle 

C'°°(^,Hom(7f^ 1 |V ®S v X 9 E 2 \y ®<S V )). 

Here 5 V —> A* d is a bundle with fiber S'(M+) on the inward pointing normal direction. 

In particular the restriction of Uq to the interior (Xq. Iq) agrees with the principal boundary 
symbol on the interior. 

ii) The principal symbol c v (A) which is the principal symbol of the pseudodifferential operator 
in the upper left corner of the matrix A. This yields a section in 

C°°(A* + ,Aom(E 1 ,E 2 )). 

in) Define by Y™'’°(X, Y\ E\, E 2 , J±) the space consisting of pairs of principal symbols (a,ag). 
These are homogenous or K-homogenous sections of the bundles A* + ,A* d , respectively, with 
canonical compatibility condition. 

Lemma 9.2. Given A,B£ By°(X, Y; Ei, E 2 , J±) we have 

a v (A ■ B) = a v (A) ■ a v (B), a})(A ■ B) = a}){A) ■ a%(B). 


Proof. From the assumption that the groupoid Q is Hausdorff we obtain by the same argument 
as in [ 29 ], p.ll] that the vector representation furnishes an isomorphism 

(X,Y]E 1 ,E 2 ,J±) = B 0,0 (<3 + , X] Ei, E 2 , J±). 

Since the principal and principal boundary symbol are each defined invariantly on the bundles 
A* +1 A*q the computation reduces to the equivariant families of Boutet de Monvel operators. 
Hence given A = (. A x ) xeX , B = (. B x ) xeX in B 0fi (G + , X; E lt E 2 , J±) we have 

&d{A ■ B~) — o’o((A x • B x ) X £x) — {&d(A x • B x f) x ^x 
= [<Jg^Ax) ■ (Jg(yB x y) X (ix = ^gi,A) ■ <Jg(B). 

In the same way we obtain multiplicativity of the principal symbol. □ 
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Since we will in the following only be concerned with represented operators we will simply write 
a and erg for cr v and erg. 

For the following result and proof in the standard case see e. g. [33]. 

Theorem 9.3. The following sequence is exact 


Y ; E U E 2 , J±>-> B$°(X, Y ; EyE 2 ,J ± ) £°’°(V, Y ; E U E 2 ,J±). 


Proof, i) The same exact sequence holds for the interior calculus. Since the principal symbols are 
extensions of the interior we immediately obtain that ker a © ag = ker a D ker ag = By 1 '°(X, Y). 
ii) To prove surjectivity let ( a,ag ) G Ey°. 

Since we also have an analogous exact sequence for the class of pseudodifferential operators 
^ suffices to find singular Green, trace and potential operators in the preimage. 

In a fixed small tubular neighborhoods = Y[ e ) trivialize the singular normal bundle Af. Let {C/,} 
be a normal covering of Y (assumed finite by compactness of Y ) and let {(/?*} be a subordinate 
partition of unity. We also fix a boundary defining function py : M — > R such that {py = 0} = Y. 
This is defined by the tubular neighborhood theorem for Lie manifolds (cf. [2]). Hence for the 
diffeomorphism of tubular neighborhoods v. Y x (—e, e) —> U C M we have 

(py o v)(x’, Xfi) = x n , x 1 G Y, x n G (-e, e). 

Let (p G C°°(E_)_) be a cutoff function such that <p(x n ) = 0 close to 0. Hence we can locally on 
each trivialization A/j = Ui x M+ construct singular Green, potential and trace operators. Via 
our partition of unity we obtain corresponding global symbols. 

This furnishes a global right inverse morphism Opy: Ey° —> £>y°. □ 

The notion of ellipticity we introduce here is the usual condition of Shapiro-Lopatinski type. It 
is sufficient to obtain a parametrix. We obtain Fredholm operators if we additionally request 
the invertibility of the indicial symbols. 

Definition 9.4. An operator A G By’°(X,Y) is called 

i) V-elliptic iff (a m © ag)(A) is pointwise bijective, 

ii) elliptic if A is V-elliptic and for each F G F\(X) the indicial symbol IZy(A) is invertible. 

Remark 9.5. The elements of the symbol algebra Ey can be written more simply in terms of 
the action in the normal direction. Let us define this action for a given symbol p G Sff(A*). We 
set 

(op nP)(x',£f) = p(x',0^',D n ) + 

then in local trivializations of the bundles E\. E 2 and S v we have 

(op+ p)(x', 0: 5(1+) © C fc -> 5(1+) © C k 
where k is the fibre dimension of E \, E 2 . 

Wejwill alternatively consider these maps as operators acting on L 2 (M+), the closure of 5(M+). 
In phj ] the action in the normal direction is defined for the boundary symbols which act more 
generally as Wiener-Hopf operators on the spaces H + and their respective L 2 -closures. We will 
not need this formulation in the present work. 

Denote by p: S*Ag —> Y the canonical projection of the sphere bundle. 

Let A be V-elliptic and consider the principal symbol up of the pseudodifferential operator P in 
the upper left corner. Since the infinite dimensional bundles are trivial the action in the normal 
direction 

°Pn a P : P* E i © S v —» p*E 2 © 5 V 
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yields a Fredholm family, parametrized over S*Aq which preserves the index, cf. 
p.95. 


33], Prop. 


5, 


We can express the principal boundary symbol (with analogously defined actions in the normal 
direction for Green, potential and trace operators) 


^=( OP "ooT ” 9 


OP n 


as an element of C°°(S*Ag, Hom^E^y < 8 > S v ,p*E 2 \y < 8 > <S V ). 

Proof (of Thm. 11.31) . a) First we have to show that the symbol algebra (for the completed 
calculus) £y is closed under inverse. Specifically, let A £ By (X,Y) be V-elliptic and invertible. 
Denote by P the pseudodifferential operator in the upper left corner of A. By V-ellipticity of A 
we fix a Q £ ’Fy(M) such that a(P _1 ) = a(Q). Set Q = op (q) for a symbol q £ S°(A*). We 
want to show that there is a an elliptic boundary symbol of the form 


» S (8)=( opi : + ” w 
\ u Pn L 


OPn kj 


p* Ex (8) S v 

0 

P*J+ 


p*E 2 ( 8 ) <S V 

© 

p*J _ 


such that ag(B) = c7 q{A)~ 1 . 

For this we can adapt an approach to the problem the idea of which goes back to Boutet de 
Monvel, [7} (the index bundle, p.35) and which can be found in detail in the reference [s3]. We 
divide the argument into three parts. 

I) We have 

dimkerop^ ap < const, dim coker op,^ ap < const 

with constants independent of the parameter g £ S*Ag. Then there is a finite dimensional 
trivial subbundle W in p* E © such that 


( im vp)(x',£') + = (P* E 2 © S V )(x',a') 

for each (x'A’) G S*Aq. We obtain the index element 

ind s «^ a op+ a P £ K(S*Ag ) 

which depends on the homotopy class of the Fredholm family. Let (er^)^ 0 ,i] be a homotopy of 
elliptic symbols in S’ 0 (.4*), then 

i n d 5 Ms °P« cr( ° ) = ind SM s °p+ cr (1) . 


Hence for ap we obtain 

indsMa op+ a P = \p*J + } - \p* J_]. 


By the same argument as in [33|, Prop. 11 on page 199 it follows that 

indsM* op +p£ p*K{Y). 

Claim: By (fl7l) there is a Green symbol go and bundles J + , J_ —> Y such that 

ker 5 Ma (op+ a P + op n g 0 ) = p* J+, 
coker s*Ae(op£ crp + op n g 0 ) = p*J~. 


For the proof see (33|, p. 201. 


(17) 
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II) The construction of the boundary symbol is a parameter dependent construction of C°°- 
boundary symbol (an isomorphism) 


f °Pn Q + op n gi op n k{\ 

V OPn^l © ) 


p*E x © <S V 

© 

P*J+ 


p*E 2 © <S V 

0 

P*J- 


Since op+ q is a parametrix of op^ p in the sense of Fredholm families we have by part I) 

ind,s'M e op+ q = [p* J+] - \p* J_]. 

In order to find an isomorphism of the form bg it suffices to find a Green symbol g\ with 

ker SMa (op+ q + op n gi) = p*J+, 
coker 5Ms (op+ q + op n gi)^p*J_. 

We know by the claim in part I) that there is a Green symbol go with 

Jo = ker 5Ma (op+ q + op n g 0 ) = p* j£, 

Jq = coker 5 *^ a (op+ q + op„ g 0 ) = p*C N 

for suitable vector bundles — >• Y and N such that 


[p* J+] - [C"] = \p*J+] - \p*J-] 


by Lemma 5, p. 203 133]. 


For N sufficiently large there are decompositions 


J+ — ©</_)_, Jo — IF' © J— j 

J 0 + “ V © J+, C N = W(BJ- 


for vector bundles V, W —> Y with isomorphisms 


v = p*v. ; j+ = p*j+, w = P *w, j_ “ P * j_ 


where op+ q + op n go induces an isomorphism /3: W —> V. There is a Green symbol g 2 so that 
the isomorphism (3 is induced by — op ra g 2 and that op ra g 2 vanishes on the complement of W in 
p*E © 5 V . Then gi = go + <72 is a Green symbol with the desired property. 

Ill) The inverse of ag = crg(A) can be calculated separately for each g G S*Ag (cf. 2.1.2.4, 
Prop. 6, p. 110). What is left to show is the smoothness of the inverse symbol depending on 
g G iSP.Tg. For bg the smoothness is clear. Additionally, the composition of smooth symbols 
yields smooth symbols. Thus eg = agbg is in C 00 (5*Jla). Hence if we can show that Cq 1 is C°° 
= bgcg 1 is C°°. This is a lenghy but elementary calculation for which we 


we obtain that a d 1 


refer to Prop. 6, p. 204-206 in [33]. 


The parametrix is obtained as follows. 
i) From the exact sequence given in Theorem 


, 0,0 


there is a 8 £ B v ( X , Y) such that 


(cr © ag)(B) = (a © ag)(A) 


-l 


Then by the multiplicativity of the principal symbol and the principal boundary symbol it follows 
that 


(a © <yg){I — AB) = 0. 
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Applying the exact sequence once more we have that R := I — AB E By 1,0 (A", Y). Hence B is 
a right parametrix of A of order 1. Setting B k = B(I + R + • • • + R k ~ 1 ) we obtain 

AB k = (/ - R)(J + R + • • • + R^" 1 ) = I — R k 
with R fc E By ’ (A, Y"). Thus B k is a right parametrix of A of order k. 

ii) Let (B k ) k£ ^ 0 be a sequence of right parametrices of A of orders k E No- By asymptotic 
completeness we can find B Yi Bi such that AB — I E By 00,0 (A, Y). Hence we have found a 
right parametrix up to residual terms. 

Hi) Fix a right parametrix up to residual terms B\ of A. Analogously to i) and ii) we can find 
a left parametrix B 2 of A such that 

/ - AB X = Ri E By°°’ 0 (A, Y) and I - B 2 A = R 2 E Hy°°’ 0 (A, Y). 

Rewrite the operator AB 2 AB\ as follows 

AB 2 ABi = AB 2 (I - Ri) = A(I - R 2 )Bi = AB X - AR 2 B\ = (I - Ri) - AR 2 B\ 

hence AB 2 AB\ + AR 2 B\ = I — R\ so that 


(AB 2 A + AR 2 )Bi =I-R 1 . 
The left hand side of the previous equation equals 


AB 2 (I — Ri) + AR 2 B\ 

and note that this is = AB 2 mod Hy°°’ 0 (A, Y). 

Hence B 2 is also a right parametrix equal up to residual terms to I — R,\. Analogously one 
proves that B\ is also a left parametrix equal up to residual terms to I — R 2 . It follows that 
B\ = B 2 mod B v °°' ( X, Y) and therefore there is an operator B E By ( X , Y) equal to B\ 
mod By°°’°(A, Y) and B 2 mod Y) such that 

/ - AB E By 00,0 (A, Y), and / - BA E By°°’ 0 (A, Y). 

b) Consider the pullback algebra Ybm which is defined as the restricted direct sum of By and 
the indicial algebras ©Fe.Fi(X)By^(R, F reg ). We can summarize the situation in the following 
pullback diagram. 



y=rO,0 


C rF)FeT 1 (M) 


v^O.O 


We will generalize the Fredholm conditions given in the special case of the pseudodifferential 
operators on Lie manifolds, see e.g. 291 ]. 

Claim: The following sequence is exact 


1C(L 2 V ( A)) © /C(L2 v (y))>-> By 0 (A, Y) 




Sbm- 
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The surjectivity is immediate. Let A E By°(X, Y), then we prove that 

L 2 V {X) Ll(X) 

A: © — 5 - © 

L 2 W (Y) Lyy(Y) 

is compact if and only if a(A) = 0, ag(A) = 0 and 1Zf{A ) = 0 for each F E F\{X). 

Assume that a®og® (€Bf'R-f)(A) = 0. From the short exact sequence in Theorem 19.31 it follows 
that A E By 1,0 (X, Y). Let (pf)fcFi(X) be the collection of boundary defining functions of the 
faces at infinity of X. Setting 

P-=Y[pF 

F 

we have that A = pB for some B E B V 1 '°(X, Y). Hence 

L 2 V (X) pHy(X) 

A: © ->• © 

L 2 w (Y) H^(Y) 


is continuous. 

By the generalized Kondrachov’s theorem, see [2, Theorem 3.6], we obtain that pH^(X) 
Ly(X) is compact. Also Hyy(Y) ^ Ly V (Y) = Hy^(Y) is compact. We obtain that 

L 2 V (X) L 2 v (X) 

A: © ->• © 

L 2 W (Y) Ly^(Y) 


is compact. 

For the other direction assume that A is compact. Then cr(A) = 0 and erg (A) = 0. Assume for 
contradiction that there is a face F E F\(X) such that TZf(A) ^ 0 and fix such an F. By the 
Hausdorff and amenability property of Q we can identify bijectively B^f{X, Y) = A) 

via the vector representation, see [ 29 I . p.ll]. The restriction 1Zf is dehned on the level of 
families by [A x ) x ^x ^ {A y ) y& F and by the Hausdorff property of the groupoid Q we have that 






is a continuous function for each (p E C£°(G + ), ip E C%°(X). Let x E F 


and tp E C£°(Q£), ip E Cp°(X x ) be given such that A x 



7 ^ 0 and let ip, ip be extensions 


to functions in C’p°(G + ) and C£°(X) respectively. Then we have (p y = <p \g , ip y = ip\x y for 
y E Xq. These restrictions identify as functions (p y E C£°(X 0 ) and ip y E C£° (Yo) via the 
canonical isometries G y = Xq, X y = Yq. The supports of (p y , ip y increase via y —> x for y E Xq. 
This implies weak convergence in Sobolev spaces (p y —>• 0, ip y —>• 0. By continuity it follows 


A 


y 




/ 0 . 


This yields a contradiction to the compactness of A. Hence the proof of the claim is finished. 
Set H := Ly(X) ©Lyy(y) and denote by CpH) := C(H)/JCpH) the Calkin algebra with quotient 
map qc : C(H) —> C(H). We want to show that A is elliptic if and only if A is Fredholm 
on the Hilbert space H. By amenability property of the groupoid we know that the vector 
representation furnishes an injective ^-representation (cf. [2J, Theorem 4.4]) 

vr: B°G°(X,Y) — > C(H). 
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An operator A S £(T~L ) is Fredholm if and only if qc(A) € C(T~L ) is invertible. Apply the standard 
exact sequence for the indicial symbol for order —1 (note that by invariance of each singular 
hyperface F the indicial symbol is surjective) 

ker IZp 1 >-=: 

Consider the diagram 



QC 


One can check the equality (A being SL-elliptic, see also 22, Theorem 9]) 


■w*<a))= u ct(TZf(A))U U spec(<r(A)(£)) U spec(cr,g(A)(£')) 

Fe-Fipf) £eS*A t'eS*A d 


where a ess denotes the essential spectrum and spec(crg(A)(^')) denotes the spectrum of the 
matrix defined by the operator valued symbol ctq(A) at the point 
Hence ir induces an injective ^-homomorphism 

Thus qc(A) is invertible in C(fK) if and only if {TZp 0 a © ag)(A) is pointwise invertible for each 

FeJi(x). □ 
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